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1  Summary 


The  main  goal  of  this  project  was  to  develop  efficient  clock  synchronization  schemes  to  ensure 
robust  operation  of  wireless  airborne  networks  in  conditions  of  mobility,  time-varying  channel 
conditions,  ad-hoc  decentralized  infrastructures  and  absence  of  GPS  (Global  Positioning  Sys¬ 
tems).  To  achieve  this  goal,  a  number  of  tasks  were  accomplished  in  this  project.  The  first  task 
dealt  with  in  this  project  was  the  development  of  analytical  performance  benchmarks  to  assess  the 
performance  of  clock  synchronization  protocols  for  wireless  ad-hoc  networks  at  micro- level,  i.e., 
sub-networks  involving  the  synchronization  of  two  or  a  limited  number  of  adjacent  nodes.  This 
first  task  was  fully  addressed  in  this  project,  and  efficient  analytical  tools  to  assess  the  perfor¬ 
mance  of  clock  synchronization  algorithms  in  terms  of  the  Cramer-Rao  lower  bound  (CRLB)  and 
mean-square  error  (MSE)  were  developed.  The  second  task  of  this  project  focused  on  designing 
efficient  and  robust  clock  synchronization  algorithms  that  achieve  these  ultimate  performance 
limits,  and  on  validating  the  performance  of  these  algorithms  through  computer  simulations. 
The  second  task  was  also  successfully  addressed  in  this  project.  Finally,  the  third  major  task  of 
this  project  was  the  design  of  energy-efficient  protocols  for  synchronization  of  large-scale  wireless 
ad-hoc  airborne  networks.  Two  novel  protocols  entitled  Adaptive-Sync  Protocol  and  PBS  (Pair¬ 
wise  Broadcast  Synchronization)  Protocol,  respectively,  were  developed  for  synchronization  of 
large-scale  wireless  airborne  networks  and  shown  to  exhibit  all  the  desirable  features:  scalability, 
distributivity,  adaptivity,  energy-efficiency,  decentralized  operation,  and  ability  to  perform  local 
as  well  as  global  synchronization.  The  work  conducted  in  this  project  was  reported  in  numerous 
journal  and  conferences,  and  in  several  PhD  and  MSc  Thesis  Dissertations  at  Texas  A&M  Uni¬ 
versity  that  are  publicly  available.  Overall,  this  project  lead  to  a  large  number  of  novel  results  of 
paramount  importance  in  the  area  of  clock  synchronization  of  wireless  ad-hoc  networks  and  more 
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general  networks  such  as  Internet.  Some  of  these  results  could  be  viewed  as  real  breakthroughs. 
As  examples  of  such  breakthrough  results,  this  project  developed  clock  synchronization  schemes 
that  achieve  the  ultimate  performance  limits,  outperform  significantly  the  existing  state-of-the- 
art  schemes  and  are  robust  to  the  distribution  of  network  delays.  High-performance  extensions  of 
the  most  representative  protocols  RBS  (Reference  Broadcast  Synchronization)  and  TPSN  (Tim¬ 
ing  Synch  Protocol  for  Sensor  Networks)  proposed  for  clock  synchronization  of  wireless  ad-hoc 
(sensor)  networks  were  also  derived.  The  proposed  PBS  and  Adaptive-Sync  protocols  represent 
high-performance  energy-efficient  extensions  of  RBS  and  TPSN  protocols,  respectively. 
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2  Introduction 


Future  wireless  airborne  networks  are  envisioned  to  represent  the  next  frontier  of  networking,  to 
be  pervasive  and  ubiquitous,  and  to  provide  a  wide  range  of  services  and  applications.  This  trend 
is  underlined  by  a  number  of  technological  advances  and  demands.  The  rapidly  growing  demands 
for  mobility  and  anywhere-anytime  data  access  represents  a  major  driving  force  behind  the 
next  generation  of  mobile  wireless  airborne  networks.  Recent  technological  developments  mark 
also  the  departure  of  telecommunications  systems  from  homogeneous  networks  to  heterogeneous 
networks,  from  non-intelligent  devices  to  smart  devices,  and  from  telephony-based  services  to 
multi-media  services.  In  addition,  recent  advances  in  hardware  and  inexpensive  wireless  radio 
systems  have  made  also  possible  the  design  of  low-cost,  low-power,  and  multi-functional  sensor 
devices.  When  deployed  in  a  large  number  across  a  geographical  area,  these  sensor  devices 
create  a  self-organized  cooperative  ad-hoc  network  that  is  perfectly  fit  for  distributed  sensing 
and  automated  information  gathering,  processing  and  communication. 

Wireless  sensor  networks  have  been  recognized  as  a  revolutionary  technology  that  will  have 
a  huge  impact  on  a  broad  range  of  applications:  monitoring  the  health  status  of  humans  and 
environment,  control  and  instrumentation  of  industrial  machines  and  home  appliances,  energy- 
conservation,  security,  detection  of  chemical  and  biological  leaks,  etc.  Wireless  sensor  networks 
are  a  special  case  of  wireless  acl  hoc  networks,  and  assume  a  multi-hop  communication  framework 
with  no  infrastructure  and  where  the  sensors  cooperate  spontaneously  by  forwarding  each  other’s 
packets  from  a  source  to  a  destination  node.  The  upcoming  years  will  very  likely  witness  a 
growing  demand  for  more  intelligent  sensor  systems  that  will  be  networked  with  wireless  local 
area  networks  (WLANs),  Internet,  satellite  and  Unmanned  Aerial  Vehicle  (UAV)  networks  to 
create  a  global  wireless  airborne  network  with  increased  functionality  and  performance. 
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In  general,  for  distributed  computing  and  networking  systems,  maintaining  the  logical  clocks 
of  the  computers  in  such  a  way  that  they  are  never  too  far  apart  is  one  of  the  most  complex  prob¬ 
lems  of  computer  engineering.  Whether  it  is  the  disciplining  of  computer  clocks  with  the  devices 
synchronized  to  a  Global  Positioning  System  (GPS)  satellite  or  a  Network  Time  Protocol  (NTP) 
time  server  over  the  Internet,  it  is  possible  to  equip  some  primary  time  servers  for  the  purpose 
of  synchronizing  a  much  larger  number  of  secondary  servers  and  clients  connected  through  a 
common  infrastructure.  In  order  to  do  this,  a  distributed  network  clock  synchronization  protocol 
is  required  through  which  a  server  clock  can  be  read,  the  readings  to  other  clients  can  be  trans¬ 
mitted  and  each  client  clock  can  be  adjusted  as  required.  In  such  a  distributed  synchronization 
approach,  the  participating  devices  exchange  timing  information  with  their  chosen  reference  at 
regular  intervals  and  adjust  their  logical  clocks  accordingly. 

A  computer  clock  in  general  has  two  components,  namely  a  frequency  source  and  a  means 
of  accumulating  timing  events  (consisting  of  a  clock  interrupt  mechanism  and  a  counter  imple¬ 
mented  in  software).  The  implementation  of  the  computer  clock  in  the  operating  system  and  the 
programming  interface  differ  between  operating  systems  and  hardware  platforms.  However,  the 
basic  source  of  timing  are  an  uncompensated  quartz  crystal  oscillator  and  the  clock  interrupts 
it  generates.  Theoretically,  two  clocks  would  remain  synchronized  if  their  offsets  are  set  equal 
and  their  frequency  sources  run  at  the  same  rate.  However,  practical  clocks  are  set  with  limited 
precision  and  the  frequency  sources  run  at  slightly  different  rates.  In  addition,  the  frequency  of 
a  crystal  oscillator  varies  due  to  initial  manufacturing  tolerance,  aging,  temperature,  pressure 
and  other  factors.  Because  of  these  inherent  instabilities,  distributed  clocks  must  regularly  be 
synchronized  to  keep  them  running  close  to  each  other. 

The  Network  Time  Protocol  [23]  represents  the  most  widely  used  clock  synchronization  pro¬ 
tocol  for  large-scale  networks  with  static  topology  such  as  the  Internet.  In  NTP,  the  nodes  are 
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externally  synchronized  to  a  global  reference  time  that  is  represented  in  the  network  by  a  set  of 
master  nodes  or  time  servers  that  are  referred  to  as  layer- 1  servers.  The  entire  synchronization 
process  assumes  a  hierarchical  tree  organization  of  the  network  nodes.  Despite  its  wide-spread 
use  in  the  synchronization  of  Internet,  NTP  is  not  appropriate  for  synchronization  of  wireless 
ad-hoc  sensor  networks  that  are  subject  to  severe  energy-constraints,  dynamic  topologies  caused 
by  mobility  and  node  failures,  and  absence  of  GPS  and  global  time  references  (due  to  either 
jamming,  interferences,  or  absence  of  direct  line  of  sight  communication  links).  In  addition,  the 
service  provided  by  NTP  assumes  continuous  synchronization  of  all  the  network  nodes  with  max¬ 
imum  accuracy  and  with  no  concern  about  energy  consumption.  However,  NTP  is  not  equipped 
with  an  mechanism  to  enable  the  local  synchronization  of  a  subset  of  nodes,  and  to  keep  the 
rest  of  the  nodes  switched  to  a  power-saving  (sleeping)  state.  Since  listening  continuously  for 
the  synchronization  beacons  is  an  energy-consuming  operation,  NTP  can  not  directly  be  applied 
to  synchronization  of  energy-constrained  wireless  ad-hoc  networks  as  is  the  case  with  wireless 
airborne  networks  and  wireless  sensor  networks. 

These  considerations  illustrate  the  need  for  novel  distributed  and  scalable  synchronization 
protocols  for  wireless  ad-hoc  networks  that  in  general  must  satisfy  a  series  of  requirements: 
energy-efficiency,  robustness  with  respect  to  node  mobility  and  link/node  failures,  and  ability  to 
guarantee  the  long-term  network  synchronization  at  local  and  global  scales. 

Clock  synchronization  is  important  for  many  applications  such  as  Internet  delay  measure¬ 
ments,  cellular  networks,  data  security  algorithms,  Media  Access  Control  (MAC)  protocols  like 
Time  Division  Multiple  Access  (TDMA),  Internet  Protocol  (IP)  telephony,  ordering  of  updates 
in  database  systems,  etc.  Recently,  with  the  advent  of  Wireless  Sensor  Networks  (WSNs)  and 
Wireless  Airborne  Networks  (WANs),  developing  clock  synchronization  protocols  that  suit  their 
specific  requirements  is  becoming  an  important  research  problem  [30].  A  large  number  of  their 
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applications  require  the  clocks  of  the  nodes  to  run  synchronously  on  a  common  timescale.  This 
is  the  case  with  applications  such  as  data  fusion,  efficient  duty  cycling  operations,  acoustic 
beamforming,  localization,  security  and  object  tracking.  Unlike  conventional  networks,  energy 
efficiency  must  also  be  taken  into  account  for  addressing  the  clock  synchronization  problem  in 
WSNs  and  WANs. 


3  Methods,  Assumptions  and  Procedures 

During  the  last  two  decades,  many  clock  synchronization  protocols  have  been  proposed  such 
as  [4],  [5],  [23],  etc.  NTP  [23]  is  a  protocol  for  synchronizing  the  clocks  of  computer  systems 
over  packet-switched,  variable-latency  data  networks  and  it  represents  the  Internet  standard  for 
time  synchronization.  It  is  a  layered  client-server  architecture  based  on  the  User  Data  Protocol 
(UDP)  message  passing  which  synchronizes  computer  clocks  in  a  hierarchical  way  using  the  offset 
delay  estimation  method.  NTP’s  sender-receiver  synchronization  architecture  is  widely  accepted 
in  designing  time  synchronization  algorithms  and  consists  of  the  same  two-way  timing  message 
exchange  mechanism  targeted  in  this  paper. 

A  protocol  based  on  the  remote  clock  reading  method  was  put  forward  by  [5],  which  handles 
unbounded  message  delays  between  processes.  In  [4],  the  time  transmission  protocol  is  used  by 
a  node  to  communicate  the  time  on  its  clock  to  a  target  node,  which  subsequently  estimates  the 
time  in  the  source  node  by  using  message  timestamps  and  message  delay  statistics. 

For  ad-hoc  communication  networks,  the  time  synchronization  protocol  [28]  represented  one 
of  the  pioneering  contributions  in  this  area.  The  protocol  is  based  on  generating  timestamps  to 
record  the  time  at  which  an  event  of  interest  occurred.  The  timestamps  are  updated  by  each 
node  using  its  local  clock  and  the  time  transformation  method,  where  the  final  timestamp  is 
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expressed  in  terms  of  an  interval  with  a  lower  bound  and  an  upper  bound. 

In  the  realm  of  wireless  sensor  networks,  the  clock  synchronization  protocols  of  particular 
note  are  Reference  Broadcast  Synchronization  (RBS  [7]),  Timing  Synch  Protocol  for  Sensor 
Networks  (TPSN  [8])  and  Time  Diffusion  Protocol  (TDP  [21]).  RBS  relies  on  simultaneous 
reception  of  broadcast  pulses  by  several  nodes  transmitted  by  a  common  neighboring  node  after 
which  the  nodes  exchange  their  timestamps  and  estimate  the  relative  time  offsets  and  skews. 
On  the  other  hand,  TPSN  is  based  on  the  same  sender-receiver  paradigm  as  in  NTP,  like  many 
other  traditional  clock  synchronization  protocols.  The  basic  difference  is  that  TPSN  has  been 
molded  sufficiently  to  suit  the  requirements  of  wireless  sensor  networks.  On  the  other  side,  TDP 
establishes  a  network-wide  equilibrium  time  through  an  iterative,  weighted  averaging  technique 
based  on  a  diffusion  of  messages  involving  all  the  nodes  in  the  synchronization  process. 

In  general,  there  are  two  different  approaches  for  synchronizing  a  pair  of  nodes  which  can 
be  categorized  as  sender-receiver  synchronization  (SRS)  and  receiver-receiver  synchronization 
(RRS).  The  former  is  based  on  the  classical  model  of  two-way  message  exchanges  between  a  pair 
of  nodes.  In  contrast,  the  latter  compares  the  time  readings  of  a  beacon  packet  from  a  common 
sender  at  a  set  of  nodes.  Most  of  the  existing  time  synchronization  protocols  rely  on  one  of 
these  two  approaches.  For  instance,  RBS  is  based  on  RRS  since  it  requires  pairs  of  message 
exchanges  among  children  nodes  (except  the  reference)  to  compensate  their  relative  clock  offsets, 
while  TPSN  adopts  SRS  since  it  depends  on  a  series  of  pairwise  synchronizations  that  assume 
two-way  timing  message  exchanges. 

The  work  conducted  in  this  project  focused  in  the  following  main  directions: 

•  development  of  a  comprehensive  body  of  analytical  results  to  assess  the  ultimate  perfor¬ 
mance  limits  achievable  by  clock  synchronization  protocols,  and  design  of  energy-efficient 
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protocols  to  achieve  these  limits. 

•  development  of  energy  efficient  protocols  for  global  synchronization  of  wireless  ad-hoc  (sen¬ 
sor)  networks. 

•  design  of  synchronization  schemes  that  are  robust  to  the  high-latencies  induced  by  large 
propagation  delays,  clock  skew  variations,  and  network  traffic  delays. 

This  research  work  plays  a  fundamental  role  in  the  design  of  future  generation  of  energy-efficient 
long-lived  wireless  airborne  networks.  The  studies  offered  by  current  protocols  (RBS  [7],  TPSN 
[8],  Flooding  Time  Synchronization  Protocol  (FTSP)  [22],  tiny/mini  synchronization  [32],  dif¬ 
fusion  algorithm  [21],  etc.)  have  concentrated  on  short-term  and  small-scale  sensor  network 
synchronization,  and  are  not  fit  for  synchronization  of  long-term  and  large-scale  networks  that 
require  efficient  duty-cycling  mechanisms  in  the  presence  of  continuous  time  synchronization  (e.g., 
coordinated  actuation  and  synchronized  sampling)  and/or  sensor-initiated  (post-faeto)  synchro¬ 
nization.  The  lack  of  techniques  to  accurately  predict  the  performance  of  time  synchronization 
protocols  has  been  recently  recognized  as  an  important  obstacle  in  designing  long-lived  wireless 
sensor  networks. 

By  eliminating  the  empiric  and  highly  suboptimal  design  principles  used  in  the  current  syn¬ 
chronization  protocols,  the  design  principles  established  in  this  project  will  help  reduce  dramat¬ 
ically  the  re-synchronization  rate,  reduce  the  signaling  rate  and  transmission  packet  overhead, 
optimize  the  operation  of  existing  synchronization  protocols,  and  help  in  establishing  the  foun¬ 
dations  for  the  design  of  future  generation  of  long-lived  energy-efficient  sensor  networks.  One  of 
the  major  benefits  of  the  work  conducted  in  this  project  is  the  development  of  the  energy-efficient 
Adaptive-Sync  and  PBS  (Pairwise  Broadcast  Synchronization)  protocols  for  long-term  synchro¬ 
nization  of  sensor  networks.  The  Adaptive-Sync  Protocol  exhibits  a  number  of  very  attractive 
features  for  synchronization  of  sensor  networks: 


•  it  represents  a  significantly  enhanced  and  natural  extension  of  NTP  and  TPSN  for  global 
synchronization  of  large-scale  ad-hoc  networks 

•  it  aims  at  minimizing  the  energy  consumption  in  large-scale  and  long-lived  sensor  networks 

•  it  is  equipped  with  flexible  mechanisms  to  adjust  the  synchronization  mode  (local  versus 
global),  (re-)  synchronization  period,  and  clock  phase-offset  and  skew  estimators  in  order 
to  achieve  long  term  reliability 

•  it  employs  sequential  message  exchange  techniques  and  energy-efficient  signaling  schemes 
to  reduce  further  the  number  of  RF-transmissions 

•  as  opposed  to  RBS,  TPSN,  and  FTSP  protocols  that  perform  poorly  in  high-latency  net¬ 
works,  the  Adaptive-Sync  Protocol  is  also  fit  for  networking  environments  characterized 
by  high  propagation  delays  and  clock  skew  variations,  and  exhibits  robustness  to  unknown 
network  delay  distributions. 

4  Results  and  Discussion 

In  the  present  section,  we  will  discuss  the  major  results  that  were  accomplished  in  this  project. 

4.1  Efficient  Clock-Offset  Compensation  Schemes  for  Local  Network 
Synchronization 

The  very  first  step  in  designing  an  efficient  synchronization  protocol  is  to  develop  efficient  schemes 
for  pairwise  synchronization  of  two  nodes,  and  to  understand  what  are  the  ultimate  performance 
limits  and  to  design  estimation  schemes  that  achieve  these  limits.  From  the  theory  of  point 
estimation  [19],  it  is  known  that  once  an  analytical  model  is  available  for  a  given  estimation 
method,  then  under  some  general  conditions,  a  lower  bound  for  the  variance  of  any  unbiased 
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estimator  can  be  expressed  in  terms  of  the  Cramer- Rao  lower  bound  (CRLB).  Furthermore, 
techniques  to  build  estimators  that  achieve  the  ultimate  performance  predicted  by  Cramer-Rao 
lower  bound  are  available  (e.g.,  the  maximum  likelihood  estimation  principle,  the  Rao-Blackwell 
and  Lehmann-Scheffe  constructions  of  minimum  variance  unbiased  estimators)  [19],  [15].  These 
were  the  basic  ideas  that  this  project  followed  to  assess  the  ultimate  performance  of  existing 
synchronization  schemes  and  to  develop  synchronization  schemes  that  achieve  these  performance 
limits. 

The  common  synchronization  protocols  NTP  and  TPSN  rely  on  the  clock  offset  correction 
scheme  between  two  nodes  that  assumes  the  pairwise  message  exchange  mechanism  depicted  in 
Fig.  1.  Since  the  NTP  and  TPSN  protocols  assumes  no  clock  skew  (frequency  offset)  between 
the  two  nodes,  we  will  improve  by  a  significant  margin  the  performance  of  NTP  and  TPSN 
protocols  by  the  introduction  of  a  clock  skew  correction  mechanism  within  the  same  message 
exchange  protocol  and  without  causing  any  additional  overhead.  First  we  will  derive  the  maxi¬ 
mum  likelihood  estimator  (MLE)  and  the  Cramer-Rao  lower  bound  for  the  clock  phase-offset  in 
the  presence  of  Gaussian  network  delays  and  no  clock  skew,  and  then  address  the  issue  of  clock 
skew  compensation. 

Assume  that  the  message  exchanges  that  take  place  between  two  generic  nodes  A  and  B  are 
the  ones  depicted  in  Fig.  1-a.  Node  A  sends  its  time  reading  to  Node  B,  which  records  its 
time  of  arrival  according  to  its  own  timescale.  A  similar  timing  message  exchange  is  sent 
from  Node  B  to  Node  A.  The  ith  delay  observations  corresponding  to  the  ith  timing  message 
exchange  are  given  by  Ul  =  d  +  6  a  +  X%  and  V)  =  d  —  0A  +  Yi,  respectively  (using  similar  notations 
as  in  [1]),  and  are  graphically  represented  in  Fig.  1-a.  The  fixed  value  9a  denotes  the  clock  offset 
between  the  two  nodes,  X,  and  Yt  denote  the  variable  portions  of  delays  which  are  assumed  to 
be  normal  distributed  random  variables  (RVs)  with  mean  [i  and  variance  cr2,  respectively. 
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Figure  1:  a)  Message  exchange  between  master-slave  nodes  having  clock  offset,  b)  Message 
exchange  between  master-slave  nodes  having  clock  offset  and  skew. 


Maximizing  the  likelihood  function  based  on  the  observations  and  {Yi}f=17  we  arrive  at 

the  MLE  of  clock  offset: 

N 

EVi-V)  JJ_y 

9 A  =  arg  max  [In  L  ( 6A )]  =  '  1  ^ - =  — - — ,  (1) 

where  U  and  V  stand  for  the  sample  means  of  observations  {Ui}^=l  and  respectively. 

The  CRLB  of  estimator  (1)  takes  the  form: 

2 

var(04)  >  CRLB{6a )  =  ^  .  (2) 

The  computer  simulations  illustrate  that  the  mean-square  error  (MSE)  of  MLE  (1)  is  well  pre¬ 
dicted  by  the  CRLB  (2)  for  any  number  of  observations  N  (see  Fig.  2-a).  It  is  interesting  to 
observe  that  the  expression  and  performance  of  MLE  strongly  depends  on  the  type  of  distribution 
assumed  by  network  delays  (see  Fig.  2-b).  We  have  shown  (see  the  references  [27],  [31])  that 
when  the  network  delays  are  exponentially  distributed  with  mean  a,  the  MLE  and  corresponding 
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CRLB  for  the  clock  phase  offset  assume  the  expressions: 

min  Ui  —  min  V, 

s  l<i<N  l<i<N  ,  - 

ua  =  - 2 - ’  W 

va.r(#4)  >  CRLB(Sa)  =  ^.  (4) 

Extensive  computer  simulations  illustrate  that  the  performance  of  MLEs  (1)  and  (3)  is  not 
robust  with  respect  to  (wrt)  the  network  delay  distribution.  In  other  words,  the  Gaussian  MLE 
(1)  and  exponential  MLE  (3)  perform  very  poorly  in  the  presence  of  exponential  and  Gaussian 
network  delays,  respectively.  Notice  that  this  disproportionate  behavior  is  corroborated  by  the 
totally  different  dependence  of  CRLBs  (2)  and  (4)  with  respect  to  the  number  of  observations 
N  (linear  vs.  quadratic).  This  suggests  the  need  for  robust  estimation  schemes  that  exhibit 
good  performance  irrespective  of  the  underlying  distribution  of  network  delays.  Our  preliminary 
computer  simulation  results  (see  our  preliminary  publication  [18])  show  that  the  clock-offset 
estimators  built  within  the  framework  of  sequential  Markov-Chain  Monte-Carlo  techniques  are 
robust  with  respect  to  the  distribution  of  network  delays  and  present  excellent  performance. 


Next,  based  on  the  same  pairwise  message  exchange  mechanism,  we  will  develop  a  novel 
approach  to  compensate  both  the  clock  phase  offset  as  well  as  the  skew.  Since  every  oscillator 
has  its  unique  clock  frequency,  the  clock  offset  between  two  nodes  generally  keeps  drifting  away. 
Also,  since  a  fixed  value  model  for  clock  offset  is  not  sufficient,  estimating  the  difference  of 
clock  frequencies  (i.e.,  clock  skews)  between  two  nodes  increases  the  synchronization  accuracy 
and  guarantees  long-term  reliability  without  frequent  re-synchronization.  We  will  next  illustrate 
the  main  challenges  behind  determining  efficient  joint  ML-estimators  for  clock  phase  and  skew 
offset,  and  then  show  a  technique  to  build  high-performance  estimators  for  clock-phase  and  skew 
offset  that  are  robust  to  high-latencies  (unknown  possible  large  propagation  delays).  Due  to 
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Figure  2:  a)  Variance  of  MLE  for  the  Gaussian  delay  model  and  the  proposed  estimator  for 
Gaussian  random  delays  (cr2  =  1).  b)  Variance  of  MLE  for  the  Gaussian  delay  model  and  the 
proposed  estimator  for  exponential  random  delays  (a  =  1). 

space  limitations,  we  will  only  sketch  the  main  results.  Fig.  1-b  shows  the  effect  of  clock  skew 
(denoted  by  9b)  on  the  timing  message  exchange  between  the  two  nodes  A  and  B.  In  this  model, 
the  ?'tli  received  signal  at  the  node  B,  T2j;,  is  given  by 

T2,i  —  Ti,i  +  d  +  Xi  +  9b  (T\,i  +  d  +  Xj)  +  9a  =  (1  +  9b)  (Ti,i  +  d  +  Xj)  +  9a,  (5) 

where  the  additional  term  9b  (Tgj  +  d  +  Xt)  is  due  to  the  effect  of  clock  skew.  Similarly,  the  Ah 
received  signal  at  the  node  A,  T4jj,  is  expressed  as 

T^i  =  +  d  +  V  —  9b  (T^i  —  d  —  V)  —  9a,  (6) 

T3,i  =  (1  +  9B)(TA,i-d-Yi)  +  9A,  (7) 

where  the  term  9B  (T4)i  —  d  —  V)  is  again  due  to  the  drift  caused  by  clock  skew,  and  (7)  is 
obtained  by  re-arranging  (6).  Assuming  that  and  {Yi}f=1  are  zero  mean  independent 

Gaussian  distributed  RVs  with  variance  a2,  and  the  fixed  portion  of  delay  d  is  known,  the 
Maximum  Likelihood  (ML)  estimates  for  9 A  and  9b  can  be  expressed  in  closed-form  as  a  function 
of  unknown  delay  parameter  d  (a  result  derived  in  more  details  in  our  publication  [27]).  Notice 
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further  that  in  general  framework  networks  that  rely  on  Radio  Frequency  (RF)  transmissions  over 
short  distances,  d  can  be  assumed  known  (d  —  0),  and  the  proposed  MLEs  of  clock  phase-offset 
and  skew  are  directly  implementable. 

Since  the  clock  difference  between  two  wireless  terminals  is  monotonically  increasing  or  de¬ 
creasing  clue  to  the  linear  clock  skew  model,  the  clock  difference  will  be  maximized  between  the 
first  and  last  time  stamps.  From  this  intuition,  novel  and  practical  clock  skew  estimators  can 
be  developed  by  using  the  first  and  last  observations  of  timing  message  exchanges.  The  idea  is 
to  build  clock  skew  estimates  that  maximize  the  likelihood  function  based  on  the  first  and  last 
observations  of  timing  stamps.  From  (5),  subtracting  T2.\  from  T2,n  gives 

T2,n  ~  T2, i  =  Tqjv  —  Ti,i  +  Xn  —  X\  +  6b  (T\,n  —  Ti, i  +  Xn  —  X\) .  (8) 


Similarly  from  (6),  subtracting  T41  from  T^N  yields 


Ta,n  —  Tiu  —  T3jN  —  r3jl  +  Y]y  9b  {Ta,n  ~  ^4,i  —  (Vv  ~  ^i))  • 


(9) 


Define  the  differences  of  the  first  and  last  time  stamps  as  =  Yhf=2D\,i  =  T^N  —  Tjj  , 
Dp)  =  Et=2%  =  T2!n—T2ji,  3)  =  J2iL2D3,i  =  T3'N—T3ti,  and  =  T^N— T4ji, 

respectively,  and  where  Dki  =  Tk  i  —  Tki_i  captures  the  difference  between  two  consecutive  time 
stamps  (k  —  1, . . . ,  4,  l  —  2, . . . ,  N).  Then,  (8)  and  (9)  can  be  rewritten  respectively  as 


D( 2)  =  D(1)  +  P  +  6b  (D( i)  +  P )  , 
D( 4)  =  D( 3)  +  R  +  6b  (-0(4)  —  R )  , 


where  P  —  Xn  —  X\  and  R  =  Y/v  —  Yi-  Since  Xn,  X\,  Yn,  and  Y\  are  i.i.d.  (independent  and 
identically  distributed)  normal  distributed  RVs  with  variance  a2,  P  and  R  are  zero-mean  normal 
distributed  RVs  with  variance  2 a2,  respectively.  So  the  joint  Probability  Density  Function  (PDF) 
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where  X[  =  (1  +  0B)  X^  Y'  =  (1  +  6b)  Yt,  and  d'  =  (1  +  0B )  d ,  respectively.  Since  the  clock-skew 
is  compensated,  eqs.  (12)  and  (13)  suggest  that  the  same  ML  clock  offset  estimators  as  in  (1) 
and  (3)  for  Gaussian  and  exponential  delay  models,  respectively,  can  be  applied  to  arrive  at  the 
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estimates: 


Oa  = 

u'-v' 

(Gaussian  delays), 

(14) 

2 

6  A  = 

min  U-  —  min  V- 

1  <i<N  1  <i<N 

(exponential  delays). 

(15) 

2 

Fig.  2-a  compares  the  MSEs  of  the  proposed  clock-skew  estimator  (11)  for  the  Gaussian  delay 
model  with  MLE  (that  assumes  knowledge  of  d)  and  corresponding  CRLB  in  Gaussian  random 
delay  channels  (a2  =  1).  It  can  be  seen  that  the  proposed  estimator  (11)  performs  close  to 
MLE,  is  consistent  and  asymptotically  efficient.  Fig.  2-b  shows  the  variance  of  the  counterpart 
estimator  (11)  for  the  exponential  delay  model  and  that  of  MLE  (that  assumes  knowledge  of 
d)  for  the  Gaussian  delay  model  in  exponential  random  delay  channels  (a  =  1).  It  can  also  be 
seen  that  the  proposed  estimator  is  consistent  and  exhibits  comparable  performance  to  the  ideal 
MLE. 

4.2  Adaptive-Sync  Protocol  for  Global  Network  Synchronization 

The  work  conducted  in  this  project  also  lead  to  the  development  of  a  significantly  enhanced 
extension  (named  Adaptive-Sync  Protocol)  of  NTP  and  TPSN  protocols.  Adaptive-Sync  adap¬ 
tively  optimizes  some  crucial  network  parameters,  such  as  the  synchronization  mode,  the  re¬ 
synchronization  period  and  the  number  of  beacons  per  pairwise  synchronization,  with  respect  to 
the  current  network  status.  The  Adaptive-Sync  Protocol  consists  of  three  functional  phases: 

•  Level  discovery  phase-.  This  phase  is  the  same  as  that  in  TPSN,  and  is  used  for  generating 
a  hierarchical  structure  in  the  network. 

•  Synchronization  phase:  It  is  similar  to  the  corresponding  synchronization  phase  in  TPSN. 
However,  as  opposed  to  TPSN,  the  Adaptive-Sync  Protocol  adjusts  not  only  the  current 


16 


clock  offset  but  also  the  clock  skew  to  guarantee  the  long  term  synchronization,  while 
TPSN  only  estimates  the  clock  offset.  Hence,  the  Adaptive  Sync  Protocol  requires  far  less 
frequent  re-synchronization. 

•  Network  evaluation  phase :  The  reference  node  investigates  the  current  status  of  network 
traffic  in  order  to  select  the  synchronization  mode  between  always  on  (AO)  (always  maintain 
network-wide  synchronization)  and  sensor  initiated  (SI)  (synchronize  only  when  it  needs 
to).  Besides,  it  optimizes  the  re-synchronization  period  and  the  number  of  beacons  per 
each  pairwise  synchronization. 

The  second  and  third  phases  (i.e.,  synchronization  and  the  network  evaluation  phases)  will  be 
periodically  repeated  in  order  to  minimize  the  overall  energy  consumption  with  respect  to  the 
current  network  status.  The  Adaptive-Sync  Protocol  assumes  also  a  number  of  additional  pa¬ 
rameters  such  as  latency  factor,  average  number  of  hops,  and  timing  synchronization  period 
to  optimize  the  overall  performance  of  synchronization  protocol.  Relative  to  TPSN  protocol, 
Adaptive-Sync  assumes  the  additional  network  evaluation  phase,  while  the  functions  of  the  other 
two  phases  present  some  common  similarities  with  the  ones  encountered  in  TPSN.  In  the  syn¬ 
chronization  phase,  Adaptive-Sync  estimates  not  only  the  current  clock  drift  but  also  the  clock 
frequency  (skew)  to  guarantee  long  term  reliability  of  synchronization  while  TPSN  only  estimates 
the  clock  offset,  and  therefore  TPSN  might  require  more  frequent  network-wide  synchronization. 
Robustness  to  high-latencies  and  distribution  of  network  delays  is  ensured  based  on  the  clock 
estimators  presented  in  the  previous  section.  Furthermore,  Adaptive-Sync  adapts  the  clock  offset 
and  skew  estimators  in  order  to  achieve  long  term  synchronization. 

As  TPSN,  generating  a  hierarchical  structure  in  the  network,  the  level  discovery  phase,  is  the 
first  step  of  Adaptive-Sync.  In  this  phase,  every  single  node  in  the  network  will  be  assigned  a 
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level  and  gets  ready  for  synchronization.  Upon  creating  the  network  hierarchy,  the  reference  node 
investigates  the  current  status  of  network  traffic  in  order  to  adjust  the  period  of  synchronization 
and  select  the  synchronization  mode  between  always  on  (AO  -  always  maintain  network-wide 
synchronization)  and  sensor  initiated  (SI  -  synchronize  only  when  it  needs  to).  This  step  stands 
for  the  network  evaluation  phase,  and  its  goal  is  to  minimize  the  number  of  message  exchanges 
for  synchronization  in  a  given  time  interval,  i.e.,  it  aims  to  minimize  total  energy  consumption 
for  synchronization.  The  third  step  of  Adaptive-Sync,  called  network-wide  time  synchronization, 
consists  in  the  pairwise  synchronization  between  adjacent  nodes  until  every  node  in  the  network  is 
synchronized  to  the  reference(s).  Adaptive-Sync  periodically  repeats  the  network  evaluation  and 
synchronization  phases  to  minimize  the  total  energy  consumption  in  the  network  with  respect  to 
the  current  network  status. 

Another  critical  problem  is  to  determine  the  required  number  of  timing  message  exchanges 
per  each  pairwise  synchronization.  To  achieve  higher  synchronization  accuracies,  a  larger  num¬ 
ber  of  message  transfers  and  an  additional  signal  processing  workload  are  needed  during  each 
pairwise  synchronization.  As  the  number  of  required  timing  messages  per  each  pairwise  synchro¬ 
nization  increases,  the  overall  number  of  timing  messages  in  a  synchronization  period  increases. 
Hence,  there  is  a  tradeoff  between  accuracy  and  energy  consumption.  To  address  these  design 
challenges,  next  we  propose  an  adaptive  clock  synchronization  algorithm  to  aid  in  selecting  the 
synchronization  mode  between  AO  and  SI,  the  period  of  synchronization  r,  and  the  number  of 
message  exchanges  per  pairwise  synchronization  N  aiming  at  efficient  usage  of  network  resources 
for  reduced  energy  consumption.  The  network  parameters  are  summarized  as  follows: 

•  B :  number  of  branches  in  a  spanning  tree  of  the  network. 

•  r:  period  of  clock  synchronization. 
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•  h:  average  number  of  hops  per  unit  time 

•  6:  latency  factor  reflecting  the  amount  of  allowed  delay  in  data  transmission 

•  N:  number  of  message  exchanges  per  pairwise  synchronization 


The  number  of  branches  in  the  network  B  can  be  obtained  after  the  level  discovery  phase.  The 
latency  factor  5  should  be  fixed  according  to  the  type  of  sensor  network  and  its  range  is  from 
0  to  1.  The  higher  latency  factor  means  higher  concern  for  network  delays.  In  every  sensing 
event,  the  destination  node  adds  the  number  of  hops  that  have  occurred  in  that  particular 
transmission  to  its  storage.  During  the  next  synchronization  phase,  the  reference  node  collects 
the  information  of  the  total  number  of  hops  occurred  in  the  last  sync  period  and  determines  the 
average  number  of  hops  per  unit  time  (h)  in  the  network.  As  mentioned  earlier,  the  goal  of  the 
adaptive  clock  synchronization  algorithm  is  to  minimize  the  number  of  required  timing  messages. 
In  an  AO-mode,  the  number  of  timing  messages  per  unit  time  is  given  by  M  =  2BN/t,  while 
in  the  Si-mode,  M  =  2hN.  To  minimize  the  number  of  timing  messages  per  unit  time  M,  the 
synchronization  mode  should  be  selected  as  follows: 


2BN5AO 
T  SI 


2hN, 


(16) 


where  the  latency  factor  5  varies  from  0  to  1  such  that  the  more  delay-dependent  networks 
assume  a  larger  value  of  6  and  vice  versa  (0  <  5  <  1).  For  example,  5  is  set  to  0  for  sensor 
networks  requiring  network  synchronization  all  the  time  (only  AO  mode  is  available).  On  the 
other  extreme,  for  delay-independent  networks,  6  should  be  close  to  1. 

As  the  period  of  timing  synchronization  r  is  getting  larger,  the  network  is  getting  power 
efficient.  Thus,  r  should  be  chosen  as  large  as  possible.  However,  a  too  large  value  for  r 
induces  a  critical  synchronization  problem  since  the  clock  drift  between  nodes  keeps  generally 
increasing  with  time.  Hence,  there  exists  a  maximum  value  of  timing  sync  period  (r  =  rmax) 


19 


which  is  determined  by  the  oscillator  characteristics  (hardware  specifications)  and  the  accuracy 
of  estimators.  Notice  that  (16)  can  be  rewritten  as 

ao  B5 

W  ^  (=  Th).  (17) 

si  h 

Thus,  the  sync  mode  changes  from  AO  into  SI  when  T \  is  greater  than  Trnax .  In  the  Si-mode,  the 
reference  node  periodically  asks  the  number  of  hops  that  occurred  during  the  past  time  interval, 
and  then  make  a  decision  whether  or  not  to  switch  to  the  AO-mode.  In  fact,  rmax  is  dependent 
on  N  since  it  strongly  depends  on  the  accuracy  of  timing  offset  estimators.  A  more  detailed 
analysis  of  rmax  is  provided  next. 

The  synchronization  phase  performs  pairwise  synchronization  among  a  set  of  nodes  by  ex¬ 
changing  timing  messages.  For  the  AO-mode,  a  series  of  pairwise  synchronization  will  take  place 
until  every  node  in  the  network  is  synchronized  to  the  reference  node,  i.e.,  the  message  exchanges 
are  occurring  at  all  branches  of  the  network  spanning  tree.  On  the  other  hand,  for  the  SI  mode, 
only  nodes  participating  in  the  particular  multi-hop  data  transmission  synchronize  with  each 
other.  The  number  of  timing  messages  per  pairwise  synchronization  is  a  critical  parameter  to 
determine  both  the  synchronization  accuracy  and  power  efficiency.  The  clock  error  (difference)  £ 
between  two  nodes  A  and  B  that  exchange  N  timing  messages  is  modeled  as  follows:  £  =  £0  +  £st, 
where  t  denotes  the  time,  e0  and  es  stand  for  the  clock  offset  and  skew  estimation  errors,  re¬ 
spectively.  Let  e0ti  and  £S)l  denote  the  clock  offset  and  skew  estimation  errors  when  N  =  i 
message  exchanges  occur  between  the  two  nodes.  Both  these  errors  can  be  well  modeled  by 
normal  distributions:  e0^  ~  N(0 ,<t2£o),  and  ESt  i  r'w/  iV(0,  .).  Therefore,  £  ~  lV(0,of),  where 

a‘l  =  +  cr|  iV An ax >  (t  =  Tmax)  ■  Imposing  the  upper- limit  £max  for  the  clock  error  via  the 

probabilistic  measure: 

P  (M  <  £max)  =  2erf  ,  (18) 
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leads  to  the  maximum  period  for  clock  synchronization: 


/  cr2  —  cr2 

(TV)  _  /  £  £o,N 

'max  \  o 

V  al,N 


Indeed.  Imposing  the  upper-limit  £max  for  the  clock  error  via  the  probabilistic  measure: 


Ps  =  Pr( \e\  >  £ m ax)  =  er/c 


where  erfc(x)  =  2/y/7T  •  J°°  exp  {—t2)dt  and  Ps  denotes  the  synchronization  error  probability  for 
pairwise  synchronization.  Thus,  oy  can  be  determined  when  £max  and  the  maximum  allowable  Ps 
are  fixed.  For  instance,  when  Ps  is  limited  to  0.1%  and  £max  is  10ms,  then  the  standard  deviation 
of  clock  mismatch  ( a£ )  has  to  be  smaller  than  3.04ms. 

The  maximum  re-synchronization  period  with  N  beacons  can  be  written  as 

la2  —  of 

rffl  =  J  2  ■  (20) 

Based  on  the  lower  bounds  and  asymptotic  performance  of  the  estimators,  one  can  easily  infer 
closed-form  expressions  of  the  variances  eQijv  and  £s^n  hr  terms  of  the  variances  £0i\  and  £S) 2, 
respectively.  From  the  lower  bounds  that  we  derived  in  [27],  cr2oN  can  be  written  with  respect 
to  N  and  a2  ,  as 

to,  1 

2  1 

Z  _  to,l 

£ o,n  jy 

Similarly,  since  the  time  differences  between  beacons  are  proportional  to  N  and  by  far  greater 
than  the  variance  of  delays,  the  following  relationship  can  be  obtained  from  the  lower  bound  for 
the  clock  skew  estimator  derived  in  [27]: 


(AT -1)2’  N-2' 


Therefore,  for  N  >  2,  can  be  rewritten  as 


4!£  =  cv-i)- 


2  _ 

ue  N 


N>  2. 
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Note  that  £S;i  can  be  obtained  by  the  specifications  of  the  crystal  oscillator,  and  £0ii  and  eSt2  can 
be  determined  by  simple  experimental  tests.  Therefore,  the  maximum  re-synchronization  period 
is  proportional  to  the  number  of  beacons,  and  performing  clock  skew  estimation  will  significantly 

(N)  ■  ^ 

increase  w  since  a£s  l  »  a£s  2. 


4.2.1  Number  of  Beacons  Required  for  Each  Pairwise  Synchronization 


The  goal  of  the  Adaptive-Sync  Protocol  is  to  minimize  the  average  number  of  message  exchanges 
( M ).  Hence,  from  (20),  finding  the  optimal  number  of  beacons  (N)  resume  to  solving  the 
following  optimization  problem 

N  —  arg  min  M,  (22) 

n  v  ' 


with 


M 


2  BN 

AN)  (N) 
l  sync  I  /  max 


2  B 


•sj/ncTy  -^2 

M 

2  B 

(N) 

Tsync  ,  N  —  1 

N  '  N  \ 

°A,2 

N  =  1 

N  >  2 


where  TgyJc  denotes  the  synchronization  time  with  N  beacons  and  will  be  estimated  at  the 
reference  node  for  different  Ns  when  the  network  is  first  established.  Once  N  is  estimated  from 
(22),  Tmal  can  be  obtained  from  (21). 

Simulation  results  in  Fig.  3  (see  [25]  and  [26]  for  more  detailed  results)  show  that  the 
Adaptive-Sync  Protocol  requires  a  far  less  number  of  timing  messages  than  TPSN  and  RBS 
when  there  exist  multiple  number  of  beacon  transmissions.  Moreover,  the  gap  between  the 
average  number  of  required  timing  messages  between  the  Adaptive-Sync  Protocol  and  TPSN 
and  RBS  significantly  increases  as  N  increases,  and  thus  Adaptive-Sync  is  by  far  more  energy- 
efficient  than  TPSN  and  RBS  for  large  Ns.  Moreover,  the  Adaptive  Synch  Protocol  is  applicable 
to  various  different  types  of  sensor  network  applications. 
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Transmission  Range  =  25,  Area  =  100  x  100,  Number  of  beacons  ( N )  =  10 


Figure  3:  Required  number  of  message  exchanges  with  respect  to  the  number  of  sensor  nodes. 

4.3  Pairwise  Broadcast  Synchronization  (PBS)  Protocol 

A  major  outcome  of  the  work  conducted  in  this  project  was  the  development  of  an  energy-efficient 
clock  synchronization  scheme  for  wireless  sensor  networks  (WSNs)  based  on  a  novel  receiver- 
receiver  synchronization  approach.  Within  this  synchronization  approach,  a  subset  of  sensor 
nodes  are  synchronized  by  overhearing  the  timing  message  exchanges  of  a  pair  of  sensor  nodes. 
This  represents  a  very  practical  and  realistic  scenario  for  wireless  airborne  networks  because  a 
group  of  sensor  nodes  can  be  synchronized  without  sending  any  extra  messages.  This  novel  syn¬ 
chronization  protocol  brings  two  main  contributions.  The  first  contribution  is  the  development 
of  a  novel  synchronization  approach  which  can  be  partially  or  fully  applied  for  implementation  of 
new  synchronization  protocols  and  for  improving  the  performance  of  existing  time  synchroniza¬ 
tion  protocols.  The  second  contribution  consists  in  the  design  of  a  time  synchronization  scheme 
which  significantly  reduces  the  overall  network-wide  energy  consumption  without  incurring  any 
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Figure  4:  Receiver-only  synchronization. 

loss  of  synchronization  accuracy  compared  to  other  well-known  schemes. 

Dne  to  the  power  constraint,  the  communication  range  of  a  sensor  is  strictly  limited  to  a 
(radio-geometrical)  circle  whose  radius  depends  on  the  transmission  power  (see  Fig.  4).  In 
Fig.  4,  every  node  within  the  checked  area  (e.g.,  Node  B)  can  receive  messages  from  both 
Node  P  and  Node  A.  Suppose  that  Node  P  is  a  parent  (or  reference)  node,  and  Node  P  and 
Node  A  perform  a  pairwise  synchronization  using  two-way  timing  message  exchanges.  Then,  all 
the  nodes  in  the  checked  region  can  receive  a  series  of  synchronization  messages  containing  the 
information  about  the  time  stamps  of  the  pairwise  synchronization.  Here,  we  assume  perfect 
communications  (no  data  loss  and  failure)  at  the  physical  layer.  Using  this  information,  Node  B 
can  be  also  synchronized  to  the  parent  node  Node  P  by  applying  a  similar  method  as  in  RBS 
and  with  no  extra  timing  messages.  Indeed,  Node  P  and  Node  A  can  be  regarded  as  super  nodes 
since  they  provide  synchronization  beacons  for  all  the  nodes  located  in  their  vicinity. 

The  work  conducted  in  this  project  lead  to  the  development  of  a  new  clock  synchronization 
approach,  named  receiver-only  synchronization  (ROS).  Similarly  to  Node  B  in  Fig.  4,  a  group  of 
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sensor  nodes  can  be  synchronized  by  only  receiving  timing  messages  of  a  pairwise  synchronization 
based  on  ROS.  The  proposed  PBS  scheme  efficiently  combines  both  SRS  and  ROS  approaches  to 
achieve  network-wide  synchronization  with  a  significantly  reduced  number  of  timing  messages. 
Next  we  will  describe  and  analyze  the  features  of  the  proposed  synchronization  scheme  in  more 
detail. 

4.3.1  Pairwise  Sender-Receiver  Synchronization 

This  subsection  illustrates  how  a  parent  node  Node  P  and  Node  A  can  be  synchronized  using 
SRS.  The  clock  model  for  the  two-way  message  exchange  is  depicted  in  Fig.  5,  where 
denotes  the  clock  offset  between  Node  A  and  Node  P  and  timing  messages  are  assumed  to  be 
exchanged  multiple  (IV)  times  [34],  [8].  Hence,  the  number  of  observations  (sets  of  time  stamps) 
becomes  N.  Here,  the  time  stamps  transmitted  during  the  ith  message  exchange  t[a^  and 
are  measured  by  the  local  clock  of  Node  A,  and  T\i  and  7/  %  are  measured  by  the  local  clock  of 
Node  P,  respectively.  Node  A  transmits  a  synchronization  packet  to  Node  P,  which  contains  the 
level  and  identifier  (ID)  of  Node  A  and  the  value  of  time  stamp  T^\  Node  P  receives  it  at  T^P 
and  transmits  an  acknowledgement  packet  to  Node  A  at  X]3V  i  .  This  packet  contains  the  level  and 
ID  of  Node  P  and  the  value  of  time  stamps  T^\  and  7]jP\  Then,  Node  A  finally  receives 
the  packet  at 

Packet  delays  can  be  characterized  into  several  distinct  components:  send,  access,  trans¬ 
mission,  propagation,  and  receive  time  (see  e.g.,  [34]).  These  delay  components  can  be  further 
divided  into  two  parts:  the  fixed  portions  of  delays  in  up-  and  down-link  (d^AF\  c^PA))  anc]  the 
variable  portions  of  delays  in  up-  and  down-link  (A/-AP\  xjPA>),  respectively. 

Thus  far,  several  random  delay  models  have  been  proposed.  A  single-server  M/M/1  queue 
can  fittingly  represent  the  cumulative  link  delay  for  point-to-point  connection,  where  the  random 
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Figure  5:  Clock  synchronization  model  of  PBS. 

delays  are  modeled  as  exponential  random  variables  [1].  The  Gaussian  delay  model  is  appropriate 
if  the  delays  are  thought  to  be  the  addition  of  numerous  independent  random  processes.  In 
[7],  the  chi-squared  test  showed  that  the  variable  portion  of  delays  can  be  modeled  as  Gaussian 
distributed  random  variables  with  99.8%  confidence.  In  this  letter,  XpAP>  and  xjPA>  are  assumed 
to  be  normal  distributed  with  mean  /i  and  variance  cr2 / 2. 

From  Fig.  5,  t!'P^  and  t\A)  can  be  expressed  as 


hP)  =  r<t>  +  CL  +  d(AP)  +  X<AP>, 

Tif  =  h?  +  €,%  +  <i(PA)  +  v(PA), 


where  °-X  =  XX  md  <i,AP>  alld  'Y.<AP)  de>«>‘<!  the  fixed  and  random  portions  of  timing 
delays  in  the  message  transmissions  from  Node  A  to  Node  P,  respectively.  In  [27],  the  MLE  of 
clock  offset  was  found  to  be  given  by 

®et  =  arS  ^ax  [In  L(0$/L)]  =  (23) 

of  f  set 

with  the  delays  in  up-link  Ui  =  and  down-link  V)  =  t\A}  — Tjj’p.  From  (23),  Node  A  can 

be  synchronized  to  the  parent  node  Node  P  by  simply  taking  the  difference  of  the  average  delay 
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observations  U  =  l/N  Yln=\  —  Tjf  ]  and  V  =  1/N  j  —  T3f  ].  Note  that  applying 
a  clock  skew  correction  mechanism  guarantees  the  long-term  stability  of  synchronization,  i.e.,  a 
decrease  of  the  re-synchronization  frequency.  In  [27],  the  joint  maximum  likelihood  estimator  of 
clock  offset  and  skew  for  normal  delays  was  derived.  Although  the  effects  of  clock  skew  have  not 
been  considered  herein,  the  clock  skew  estimators  developed  in  [27]  can  be  directly  applied  to 
the  proposed  PBS  protocol  with  no  modifications. 


4.3.2  Receiver-Only  Synchronization 


In  Fig.  4,  consider  an  arbitrary  node,  say  Node  B,  in  the  checked  region.  While  Node  P  and 
Node  A  exchange  time  messages,  Node  B  is  capable  of  receiving  packets  from  both  nodes.  Hence, 
Node  B  can  observe  a  set  of  time  readings  ({Ff  f  i)  at  its  local  clock  when  it  receives  packets 
from  Node  A  as  depicted  in  Fig  5.  Besides,  the  information  about  a  set  of  time  stamps  {T^}f=1 
can  also  be  obtained  by  receiving  packets  from  Node  P.  Considering  the  effects  of  both  clock 
offset  and  skew  in  this  subsection,  the  time  stamp  at  Node  P  in  the  ith  uplink  message  T2  7  is 
given  by 


rpi.  p) 

1  2,i 


(24) 


where  0^2  stands  for  the  relative  clock  skew  between  Node  A  and  Node  P.  Likewise,  the  time 

/TD\ 

stamp  at  Node  B  in  the  7th  uplink  message  T2  7  can  be  represented  by 


71(B) 
1  2  ,i 


je(A)  ^(AB) 


3(AB) 


4-  0y 

offset  '  w skew 


(T,f 


Tff)  +  d(AB)  +  If’, 


(25) 


where  6^fset  and  9^  stand  for  the  relative  clock  offset  and  skew  between  Node  A  and  Node  B , 
d^A B)  and  denote  the  fixed  and  random  portions  of  timing  delays  in  the  message  transmis¬ 

sion  from  Node  A  to  Node  B,  respectively.  Here,  fAB)  is  assumed  to  be  a  normal  distributed 
RV  with  mean  /i  and  variance  a2  / 2. 
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Similar  to  [10],  [13],  and  [36],  the  linear  regression  technique  (line  fitting)  can  be  applied  to 
synchronize  Node  B  and  compensate  the  effects  of  the  relative  clock  skew  between  Node  P  and 
Node  B.  Subtracting  (25)  from  (24)  leads  to 


rp(P)  rp(B) 

12  ,i  12  ,i 


9 


(BP) 

offset 


,  a(  BP) 

'  u  skew 


Tff)  +  d(AP)  -  d(AB)  +  X\AP) 


X(AB) 


(26) 


Since  d^AB^  and  cAp)  are  fixed  values  and  A"-AB')  and  X^AP^  are  normal  distributed  RVs,  the 
noise  component  can  be  defined  by  z[i\  =  //'  +  AP')  —  X^AB\  where  ft'  =  gAp^  —  and 

z[i\  ~  A/”(/x/,  a2).  Let  define  x[i\  =  —  /i'  and  w[i\  =  z[i]  —  //,  then  the  set  of  observed 

data  can  be  written  in  matrix  notation  as  follows: 


x  =  KG  +  w, 


where  x  =  [x[l]  x[2]  •  •  •  x[N}}T ,  w  =  (w[l)  w[ 2]  •  •  •  w[lV]]T,  G  =  [9(BP)set  ,  and 

r  i  T 


H  = 


1 


1 


1 


pi  rp(A)  T-i(A)  rp{A)  rp( A) 

U  1  1,2  1  1,1  ‘  ‘  ‘  1  1,N  1  1,1 

Note  that  the  noise  vector  w  is  normally  distributed  w  ~  M{ 0,  <r2I),  and  the  matrix  H  represents 
the  observation  matrix  of  size  N  x  2.  From  [15,  Theorem  3.2,  p.  44],  the  least-squares  estimator 
for  the  relative  clock  offset  and  skew  is  given  by 


G  =  (HtH)-1Htx,  1(G) 


HTH 


where  1(0)  is  the  Fisher  information  matrix.  After  some  straightforward  mathematical  manipu¬ 


lations,  the  joint  clock  offset  and  skew  estimator  is  given  by 
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where  =  t[A)  —  T^.  By  inverting  the  Fisher  information  matrix  1(0),  the  Cramer- Rao  lower 
bounds  (CRBs)  for  the  relative  clock  offset  and  skew  take  the  expressions: 
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Consequently,  using  the  results  in  (27),  Node  B  can  be  synchronized  to  Node  P.  Likewise,  all 
the  other  nodes  in  the  checked  region  in  Fig.  4  can  be  simultaneously  synchronized  to  the  parent 


node  Node  P  without  any  additional  timing  message  transmissions,  thus  saving  a  significant 
amount  of  energy.  Fig.  6  shows  the  mean  square  error  (MSE)  performance  of  the  proposed  clock 
offset  and  skew  estimators  for  ROS.  It  can  be  seen  that  both  clock  offset  and  skew  estimators 


are  efficient  and  their  performance  is  well  predicted  by  the  CRBs.  Besides,  as  we  will  see  in  the 
next  section,  ROS  does  not  exhibit  any  loss  of  synchronization  accuracy  in  clock  offset  estimation 
when  compared  to  RBS. 


4.3.3  Receiver-Receiver  Synchronization 

This  section  presents  the  RRS  approach  [7]  and  compares  its  performance  with  the  proposed  ROS 
approach.  RRS  is  an  approach  to  synchronize  a  set  of  children  nodes  that  receive  the  beacon 
messages  from  the  common  sender,  a  reference  or  parent  node.  Consider  a  parent  (reference) 
node  P  and  arbitrary  nodes  A  and  5,  located  within  the  communication  range  of  the  parent 
node  in  Fig.  7.  As  depicted  in  Fig.  8,  assume  that  both  Node  A  and  Node  B  receive  the  ith 
beacon  from  Node  P  at  time  instants  and  of  their  local  clocks,  respectively.  Nodes 

A  and  B  record  the  arrival  time  of  the  broadcast  packet  according  to  their  own  timescales  and 
then  exchange  their  time-stamps.  Suppose  N-PA>  denotes  the  nondeterministic  delay  components 
(random  portion  of  delays)  and  d(PA^  denotes  the  deterministic  delay  component  (propagation 
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Figure  6:  Performance  of  PBS  clock  offset  and  skew  estimation, 
delay)  from  Node  P  to  Node  A,  then  can  be  written  as 

r«t>  =  rw  +  +  ,yPA)  +  ■  (TM  -  Tu). 


(29) 


where  Tlti  is  the  transmission  time  at  the  reference  node,  0^]et  and  d^ew  are  the  clock  offset  and 
skew  of  Node  A  with  respect  to  the  reference  node,  respectively.  Similarly,  we  can  decompose 
the  arrival  time  at  Node  B  as 


3(PA) 


7^(b)  _  y  I  ^(PB)  y(PB)  _i_  $(BB)  i  /q(bb)  (t  y  \ 

12 ,i  —  1l ,i  +  d  +Ai  +  Uoffset  + Uskew  '  V1  1,*  _  J  l.lb 


(30) 


where  rf<PB>,  V<PB>,  and  are  the  propagation  (fixed)  delay,  the  random  portion  of 

delays,  and  the  clock  offset  and  skew  of  Node  5,  respectively. 

Subtracting  (30)  from  (29),  we  obtain 

hf'  -  hB)  =  »SfL + »£A2  •  (u,<  -  u,,) + d<pA>  -  d<pp> + ,ypA)  -  xr,  (an 

where  0^:,a  (=  fl'PA]d  -  «!,PB)J  and  ^BAJ  (=  0™  -  become  the  relative  clock  offset 
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Figure  7:  Receiver-receiver  synchronization. 


and  skew  between  Node  A  and  Node  B  at  the  time  they  receive  the  ith  broadcast  packet  from 
the  reference  node,  respectively.  Note  that  (31)  assumes  exactly  the  same  form  as  (26).  Hence, 
the  same  steps  can  be  applied  to  derive  the  joint  clock  offset  and  skew  estimator  for  ROS. 
Likewise,  define  the  noise  component  z[i]  =  //  +  xjPA^  —  xjPB\  where  //  =  —  d^FB^  and 

z[i\  ~  a2).  Let  also  dehne  x[i\  =  —  /i'  and  w[i]  =  z[i\  —  n'.  Using  similar  steps 

as  in  ROS,  it  is  straightforward  to  show  that  the  same  form  of  the  joint  clock  offset  and  skew 
estimator  (27)  can  be  also  applied  to  RRS.  Consequently,  there  is  no  difference  between  ROS 


and  RRS  with  regard  to  the  accuracy  of  synchronization  since  the  effects  of  random  delays  are 
the  same.  Assuming  there  is  no  clock  skew  (0^Aj  =  0),  the  maximum  likelihood  estimator  of 
the  relative  clock  offset  0^fget  becomes 


fl(BA)  __ 

^offset 


i=l 


(32) 


which  is  the  equivalent  to  the  estimator  presented  in  [7]. 
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4.3.4  Comparisons  and  Analysis 


This  section  compares  the  proposed  PBS  with  other  well-known  synchronization  protocols,  such 
as  TPSN,  RBS,  and  FTSP,  with  respect  to  the  amount  of  energy  consumption  (number  of 
required  timing  messages)  and  the  synchronization  accuracy. 

Lemma  1  Let  Arbs  be  the  number  of  required  timing  messages  in  RBS,  then  Arbs  =  A  + 
L(L  —  l)/2,  where  L  is  the  number  of  overall  sensor  nodes  in  the  network. 

The  reference  node  must  broadcast  the  beacon  packet  A  times  in  RBS.  Besides,  every  sensor  node 
must  send  time  readings  upon  receiving  the  broadcast  beacons  with  all  the  other  nodes  in  the 
network  to  compensate  relative  clock  offsets  among  each  other  [7].  Thus,  Arbs  =  A+L(L  — 1)/2, 
since  the  number  of  unique  pairs  in  the  network  is  L(L  —  1) / 2. 

Lemma  2  Let  ATPSn  be  the  required  number  of  timing  messages  in  TPSN,  then  ATPSn  = 
2A(L  —  1). 

Since  every  node  in  the  network  is  connected  to  its  parent  node  except  a  reference  node,  there 
are  L  —  1  branches  (edges)  in  a  hierarchical  tree.  Besides,  for  TPSN,  2A  timing  messages  are 
required  in  every  pairwise  synchronization.  The  number  of  required  timing  messages  in  TPSN  is 
equal  to  the  number  of  pairwise  synchronizations  times  the  number  of  required  timing  messages 
per  pairwise  synchronization,  and  therefore  AtPsn  =  2A(L  —  1)  [8]. 

Lemma  3  Let  APtsp  be  the  number  of  required  timing  messages  in  FTSP,  then  APtsp  =  AL. 

For  FTSP,  every  sensor  node  must  send  its  time  readings  upon  receiving  beacons  (or  broadcast 
beacons)  to  other  nodes  so  that  they  can  estimate  the  relative  clock  offsets  among  each  other 
[22],  Therefore,  the  number  of  required  timing  messages  in  FTSP  is  equal  to  the  number  of 
sensor  nodes  times  the  number  of  beacons:  APtsp  =  AL. 
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Receiver-Receiver  Synchronization  (Node  A  and  Node  B) 
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Figure  8:  Clock  synchronization  model  of  RBS. 

It  is  remarkable  that  the  required  number  of  timing  messages  for  all  the  above  mentioned 
protocols  is  proportional  to  the  number  of  sensors  in  the  network  L  or  its  square  L 2 .  However,  as 
discussed,  PBS  requires  only  2N  timing  messages  in  every  synchronization  period,  i.e. ,  IVpbs  = 
2 N.  Hence,  IVpbs  dose  not  depend  on  the  number  of  sensors  in  the  network,  which  incurs  an 
enormous  amount  of  energy  saving.  Moreover,  this  gain  proportionally  increases  with  respect 
to  the  scale  of  the  network.  Consequently,  the  benefit  of  PBS  over  RBS,  TPSN,  and  FTSP  is 
clear  and  huge  in  terms  of  energy  consumption  with  the  cost  of  allocating  2  super  nodes  in  the 
network.  Note  that  RBS  also  requires  a  super  node  which  broadcasts  the  reference  beacons  to 
all  the  other  nodes  in  the  network. 

In  case  that  there  are  other  sensor  nodes  which  are  located  outside  of  the  checked  region  in 
Fig.  4,  likewise  RBS,  the  network  could  be  divided  into  a  number  of  separated  groups  (clusters) 
and  they  could  be  synchronized  by  additional  pairwise  synchronizations  among  super  nodes  in 
different  groups,  i.e.,  global  synchronization  can  be  achieved  by  a  sequence  of  pairwise  synchro¬ 
nizations.  Here,  diverse  grouping  and  pair  selection  algorithms  can  be  considered  according  to 
the  type  of  the  network.  For  instance,  assuming  that  the  level  hierarchy  of  the  network  is  dis¬ 
covered  by  an  appropriate  searching  algorithm  (e.g.,  as  in  [8]),  there  exist  groups  of  parents  and 
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children  nodes,  where  a  group  consists  of  a  parent  and  its  children  nodes.  Here,  every  parent 
node  can  investigate  the  connectivity  among  its  children  nodes  and  select  the  best  sequence  of 
synchronization  pairs  in  order  to  minimize  the  required  number  of  pairwise  synchronizations, 
which  maximizes  the  number  of  nodes  performing  ROS.  Note  that  no  network-wide  heuristic 
connection  search  is  required  in  this  case  because  of  its  limited  and  known  set  of  scanning  nodes. 
The  detailed  description  of  these  results  for  the  proposed  PBS  scheme  is  reported  in  [25]  and 
[26]. 

5  Conclusions 

Time  synchronization  is  a  significant  component  in  the  deployment  of  wireless  ad-hoc  networks, 
and  a  number  of  fundamental  operations,  like  data  fusion,  power  management  and  transmission 
scheduling,  require  accurate  time  synchronization.  Since  the  conventional  NTP  time  synchro¬ 
nization  protocol  for  the  Internet  can  not  be  directly  applied  to  wireless  sensor  networks  and 
wireless  airborne  networks,  a  number  of  synchronization  protocols  have  been  developed  in  this 
project  to  meet  the  unique  requirements  of  these  applications. 

In  this  project,  the  basic  features  and  theoretical  backgrounds  of  the  time  synchronization 
problem  in  wireless  sensor  networks  were  first  addressed  and  two  general  large  scale  network 
synchronization  protocols  were  proposed.  Besides,  a  survey  of  existing  time  synchronization 
protocols  in  the  literature  was  provided  including  the  most  recent  results.  As  the  main  con¬ 
tributions  of  this  work,  we  can  enumerate  these  major  contributions.  First,  novel  analytical 
tools  and  techniques  to  assess  the  performance  of  existing  synchronization  schemes  were  devel¬ 
oped.  Second,  a  family  of  novel  joint  clock  offset  and  skew  estimators  based  on  the  classical 
two-way  message  exchange  model  were  also  developed.  Third,  this  work  proposed  two  novel 
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energy-efficient  time  synchronization  protocols:  Adaptive-Sync  Protocol  and  Pairwise  Broadcast 
Synchronization  (PBS)  Protocol,  which  require  a  much  lesser  number  of  timing  messages  (en¬ 
ergy  consumption)  than  existing  state-of-the-art  synchronization  protocols,  and  incur  no  loss  in 
synchronization  accuracy. 

A  number  of  open  research  problems  might  be  worth  to  investigate.  Experimental  perfor¬ 
mance  evaluation  and  comparisons  with  other  existing  synchronization  protocols  represent  a 
major  open  research  work.  More  general  random  delay  models  might  be  needed  for  other  net¬ 
work  applications  (such  as  presence  of  jamming,  fading,  node  failures).  Moreover,  a  variety  of 
sophisticated  statistical  techniques,  such  as  jackknife,  bootstrap,  and  Gibbs  sampling,  could  be 
applied  to  improve  the  performance  of  clock  estimation.  These  remain  open  issues  for  another 
future  research  project. 
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Adaptive  Sync  =  Adaptive  Synchronization 
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ID  =  Identification 
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PhD  =  Doctor  of  Philosophy 
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RBS  =  Reference  Broadcast  Synchronization 


RF  =  Radio  Frequency 

ROS  =  Receiver  Only  Synchronization 

RRS  =  Receiver  Receiver  Synchronization 

RV  =  Random  Variable 
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TDMA  =  Time  Division  Multiple  Access 
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WSN  =  Wireless  Sensor  Network 
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